Finite-Time Consensus Problems for Networks 

of Dynamic Agents 

^ ; Long Wang and Feng Xiao 

O 

»— » 

in . 

, Abstract 



' In this paper, finite-time state consensus problems for continuous-time multi-agent systems are 
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discussed, and two distributive protocols, which ensure that the states of agents reach an agreement 
in a finite time, are presented. By employing the method of finite-time Lyapunov functions, we derive 
conditions that guarantee the two protocols to solve the finite-time consensus problems respectively. 
Moreover, one of the two protocols solves the finite-time weighted-average consensus problem and can 
be successively applied to the systems with switching topology. Upper bounds of convergence times are 
also established. Simulations are presented to show the effectiveness of our results. 
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ordination control. 



The theory of consensus or agreement problems for multi-agent systems has emerged as 
a challenging new area of research in recent years. It is a basic and fundamental problem 
in decentralized control of networks of dynamic agents and has attracted great attention of 
researchers. This is partly due to its broad applications in cooperative control of unmanned 
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air vehicles, formation control of mobile robots, control of communication networks, design of 
sensor networks, flocking of social insects, swarm-based computing, etc. 

In [1], Vicsek et al. proposed a simple but interesting discrete-time model of finite agents 
all moving in the plane. Each agent's motion is updated using a local rule based on its own 
state and the states of its neighbors. The Vicsek model can be viewed as a special case of 
a computer model mimicking animal aggregation proposed in [2] for the computer animation 
industry. By using graph theory and nonnegative matrix theory, Jadbabaie et al. provided a 
theoretical explanation of the consensus property of the Vicsek model in [3], where each agent's 
set of neighbors changes with time as system evolves. The typical continuous-time model was 
proposed by Olfati-Saber and Murray in [4], where the concepts of solvability of consensus 
problems and consensus protocols were first introduced. The authors used a directed graph 
to model the communication topology among agents and studied three consensus problems, 
namely, directed networks with fixed topology, directed networks with switching topology, and 
undirected networks with communication time-delays and fixed topology. And it was assumed 
that the directed topology is balanced and strongly connected. In [5], Ren and Beard extended 
the results of [3], [4] and presented mathematically weaker conditions for state consensus under 
dynamically changing directed interaction topology. In the past few years, consensus problems of 
multi-agent systems have been developing fast and many research topics have been addressed, 
such as agreement over random networks [6], [7], asynchronous information consensus [8], 
dynamic consensus [9], networks with nonlinear consensus protocols [10], consensus filters [11], 
and networks with communication time-delays [4], [12], [13], [14]. For details, see the survey 
[15] and references therein. 

By long-time observation of animal aggregations, such as schools of fish, flocks of birds, 
groups of bees, and swarms of social bacteria, it is believed that simple, local motion coordination 
rules at the individual level can result in remarkable and complex intelligent behavior at the 
group level. We call those local motion coordination rules distributive protocols. In the study of 
consensus problems, they are called consensus protocols. 

In the analysis of consensus problems, convergence rate is an important performance index of 
the proposed consensus protocol. In [4], a linear consensus protocol was given and it was shown 
that the second smallest eigenvalue of interaction graph Laplacian, called algebraic connectivity 
of graph, quantifies the convergence speed of the consensus algorithm. In [16], Kim and Mesbahi 
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considered the problem of finding the best vertex positional configuration so that the second 
smallest eigenvalue of the associated graph Laplacian is maximized, where the weight for an 
edge between two vertices was assumed to be a function of the distance between the two 
corresponding agents. In [17], Xiao and Boyd considered and solved the problem of the weight 
design by using semi-definite convex programming, so that algebraic connectivity is increased. 
If the communication topology is a small-world network, it was shown that large algebraic 
connectivity can be obtained [18]. Although by maximizing the second smallest eigenvalue of 
interaction graph Laplacian, we can get better convergence rate of the linear protocol proposed 
in [4], the state consensus can never occur in a finite time. In some practical situations, it is 
required that the consensus be reached in a finite time. Therefore, finite-time consensus is more 
appealing and there are a number of settings where finite-time convergence is desirable. The 
main contribution of this paper is to address finite-time consensus problems and discuss two 
effective distributed protocols that can solve consensus problems in finite times. Furthermore, 
the method used in this paper is of interest itself, which is partly motivated by the work of [19], 
in which continuous finite-time differential equations were introduced as fast accurate controllers 
for dynamical systems, and partly by the results of finite-time stability of homogeneous systems 
in [20]. 

The proposed protocols in this paper are continuous state feedbacks, but they do not satisfy 
the Lipschitz condition at the agreement states, which is the least requirement for finite-time 
consensus problems because Lipschitz continuity can only lead to asymptotical convergence. To 
prove that the two protocols effectively solve finite-time consensus problems, we adopt the theory 
of finite-time Lyapunov stability [19], [20]. Although for systems under general communication 
topology, it is difficult and even impossible to find the valid Lyapunov functions, we have 
succeeded in reducing the general case into several special cases, in which appropriate Lyapunov 
functions can be found. This paper shows that the convergence time is closely related to the 
underlying communication topology, especially, the algebraic connectivity for the undirected 
case. Large algebraic connectivity can greatly reduce the convergence time. We also compare the 
convergence rates of two systems under the same protocol but with different protocol parameters 
and draw the conclusion that one converges faster when agents' states differ a lot while the other 
converges faster when agents' states differs a little. This conclusion encompasses the case when 
one of the two systems adopts the linear consensus protocol presented in [4]. Therefore, in order 
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to get shorter convergence time, we can change those adjustable parameters in the proposed 
protocols according to agents' states. By the same method, we also study the case where the 
topology is dynamically changing. 

This paper is organized as follows. Section II presents the preliminary results in algebraic 
graph theory. Section III sets the basic setting in which the problem is formulated. The main 
theoretical results are established in Section IV and the simulation results are given in Section 
V. Finally, concluding remarks are provided in Section VI. 

II. Preliminaries 

In this section, we list some basic definitions and results in algebraic graph theory. More 
comprehensive discussions can be found in [21]. 

Directed graphs will be used to model the communication topologies among agents. A directed 
graph Q of order n consists of a vertex set V(G) = {vi : % = 1,2, ... ,n} and an edge set 
£{G) C {(vi,Vj) : Vi,Vj £ V(G)}. If (vi,Vj) £ £(G), Vi is called the parent vertex of Vj and Vj 
is called the child vertex of v { . The set of neighbors of vertex v,- L is denoted by N{G, f») = {vj ■ 
(vj,Vi) £ £(G),j 7^ 0- The associated index set is denoted by J\f(G,i) = {j '■ Vj £ Af(G,Vi)}. 
A subgraph G s of directed graph Q is a directed graph such that the vertex set V(G S ) C V(G) 
and the edge set £{G S ) C £{G)- If V(G S ) = V(G), we call G s a spanning subgraph of G- For 
any v i: Vj £ V(G S ), if (vi,Vj) £ £(G S ) if and only if (vi,Vj) £ £{G), G s is called an induced 
subgraph. In this case, G s is also said to be induced by V(G S )- A path in directed graph Q 
is a finite sequence v ii: . . . ,v id of vertices such that (y ik ,v ik+1 ) £ V(G) for k — 1, . . . ,j — 1. 
A directed tree is a directed graph, where every vertex, except one special vertex without any 
parent, has exactly one parent, and the special vertex, called the root vertex, can be connected 
to any other vertices through paths. A spanning tree of G is a directed tree that is a spanning 
subgraph of G- We say that a directed graph has or contains a spanning tree if a subset of the 
edges forms a spanning tree. Directed graph G is strongly connected if between every pair of 
distinct vertices v i: vj in G, there is a path that begins at and ends at vj (that is, from Vi to vj). 
A strongly connected component of a directed graph is an induced subgraph that is maximal, 
subject to being strongly connected. Since any subgraph consisting of one vertex is strongly 
connected, it follows that each vertex lies in a strongly connected component, and therefore the 
strongly connected components of a given directed graph partition its vertices. 
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Matrix A is called a nonnegative matrix, denoted by A > 0, if all its entries are non- 
negative, and is called a positive matrix, denoted by A > 0, if all its entries are positive. 
A weighted directed graph Q(A) is a directed graph Q plus a nonnegative weight matrix 
A = [aij] G R nxn such that (v i: Vj) G £{G) -<=>- a yi > 0. And aji is called the weight 
of edge (vi,Vj). Moreover, if A T = A, then Q(A) is also called an undirected graph. In this 
case, (vi,Vj) G £(A) -<=>- (vj : Vi) G and £(A) having a spanning tree is equivalent to 

Q{A) being strongly connected. Those strongly connected undirected graphs are usually called 
to be connected. In this paper, the induced subgraph of weighted directed graph Q(A) is also a 
weighted directed graph which inherits its weights in Q{A). 

Notations: Let 1 = [1,1,..., 1] T with compatible dimensions, X n — {1, 2, • • • , n}, span(l) = 
{£ G M n : £ = rl, r G R}, and p(A) denote the spectral radius of a square matrix A. For 
any 1 < p < oo, || • || p denotes the Z p -norm on W l and || ■ || ip is its induced norm on M nxn . If 
ijj = [lui, uj 2 , ■ ■ ■ , uj n ] T G W n , then diag(a;) is the diagonal matrix with the entry being ooi. 

Lemma 1 ([4], [5], [22]): Let L(A) = [Z^] G R nxn denote the graph Laplacian of G(A), 
which is defined by 

[ -^j, j i 

Then 

(i) is an eigenvalue of L(A) and 1 is the associated eigenvector; 

(ii) If Q{A) has a spanning tree, then eigenvalue is algebraically simple and all other 
eigenvalues are with positive real parts; 

(iii) If Q(A) is strongly connected, then there exists a positive column vector uj G W l such 
that uj t L(A) = 0; 

If Q(A) is undirected, namely, A T = A, and connected, then L(A) has the following 
properties: 

(iv) i T L{A)i = |E- J= i^fe- - ii? for any | = [6, 6, • • • , £«] T G K", and therefore 
L(A) is semi -positive definite, which implies that all eigenvalues of L(A) are nonnegative real 
numbers; 

(v) The second smallest eigenvalue of L(A), which is denoted by \ 2 (L(A)) and called the 
algebraic connectivity of G(A), is larger than zero; 
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(vi) The algebraic connectivity of Q{A) is equal to min^ 01 T^ =0 - ^ — , and therefore, if 
1 T £ = 0, then 

fL(A)Z > \ 2 (L(A))ft. 
Proof: Statement (i) follows directly from the definition of L(A). (ii) is a corollary of 
Lemma 3.3 or Lemma 3.11 in [5]. The last three statements appeared in [4] (see equations (15) 
(17) and Theorem 1 in [4]). 

Here, we provide the proof of (iii) for completeness, which can be extended to more general 
case, see [22]. 

Let d! = maxj la, e = maxj an + 1 and let d = d! + e. Then —L(A) = —dl + (-L(A) + dl), 
where J is the identity matrix with compatible dimensions. By direct observation, — L(A) + 
dl > A (component- wise) is a nonnegative matrix with positive diagonal entries. Since G(A) is 
strongly connected, Q(— L(A) + dl) is also strongly connected. By Lemma[4](in the Appendix), 
—L(A) + dl is irreducible, equivalently, —L(A) T + dl is also irreducible. 

By Gersgorin Disk Theorem (in the Appendix), all the eigenvalues of —L(A) are located in 
the following region: 

n n 

[j{c G C : \c + ki\ < \kj\ = hi} C {c G C : \c + d'\ < d'} 

i=l J=l 
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The eigenvalues of — L(A) + dl are located in the right circle. 
Fig. 1. Eigenvalues of —L(A) + dl 



Therefore, the eigenvalue of —L(A) + dl are located in the region {c G C : |c — e\ < 
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d'}, see Fig. [IJ Consequently, its spectral radius, p(—L(A) + dl), is not larger than d. From 
(-L(A) + dl)l = (0 + d)l = dl, we have that d is an eigenvalue of —L(A) + dl, and thus 
p(— L(A) + dl) = d. By Perron-Frobenius Theorem (in the Appendix), there exists a positive 
column vector uj such that (— L(A) T + dl)uj = dus. Therefore, lj t L(A) = u; T (dI) — dus T = 0. 

■ 

Corollary 1: Suppose G(A) is strongly connected, and let uj > such that u) T L(A) = 0. 
Then diag(o;)L(A) + L(A) T diag(o;) is the graph Laplacian of the undirected weighted graph 
G(di&g((jj)A + A T diag(u;)). And therefore it is semi-positive definite, is its algebraically 
simple eigenvalue and 1 is the associated eigenvector. 

Proof: Since the definition of graph Laplacian L(A) is independent of the diagonal entries 
of A, without loss of generality, we assume that the diagonal entries of A are all zeros (in the 
subsequent sections, A will be assumed to be with zero diagonal entries). Then by the definition 
of graph Laplacian, we have that 



L(A) = diag(Al) - A 



(1) 



Then 



diag(w)L(A) 



diag(o;)(diag(Al) 



A) 



diag(diag(w)Al) 



diag(u;)A 



L(diagMA) (by ©) . 



(2) 



Since uj t L(A) = 0, 1 T diag(u;)L(A) 



0. Therefore, 



=l T diag(u;)L(A) = l T L(diag(u>)A) 
=l T diag(diag(u;)Al) - l T (diag(u;) A) 
=l T A T diag(u;) - l T (diag(u;)A). 



Thus, 



diag(w)Al = A diag(u;)l. 



(3) 
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Therefore, 

L(A) T diag(u;) =L(diag(» A) T (by ©) = diag(diag(w) Al) - (diag(u)A) T 
= diag(A T diag(u;)l) - A T diag(u;) (by ©) 
=L(A T diag(u;)) (by ®) . 

Moreover, by (OQ), we can see that for any nonnegative matrices A\ and A 2 , L(A 1 ) + L(A 2 ) = 
L(A 1 + A 2 ). Therefore, 

diag(u;)L(A)+L(A) T diagM = L(diag(a;)A) + L(A T diag(w)) 
= L(diag(u;)A + A T diag(u;)). 

■ 

Corollary 2: Let b = [b±, b 2) . . . , b n ] T > 0, b ^ 0, and let be undirected and connected. 

Then L(A) + diag(6) is positive definite. 

Proof: By Lemma Qliv), L(A) + diag(b) is semi-positive definite. If there exists a vector 
^6l" such that £ T (L(A) + diag(6))£ = 0, then by lemma [Q we have 

(i) $ e span(l); 

(ii) ^ T diag(b)£ = 0, which implies that some entries of £ are zeros. 

Hence, £ = and L(A) + diag(6) is positive definite. ■ 

III. Problem Formulation 

The distributed dynamic system studied in this paper consists of n autonomous agents, e.g. 
particles or robots, labeled 1 through n. All these agents share a common state space M. The 
state of agent i is denoted by Xj, i — 1, 2, . . . , n and let x = [x\, x 2 , ■ ■ ■ , x n ] T . 

Suppose that agent i, i E l n , is with the following dynamics 

±i(t) = Ui(t), (4) 

where Ui(t) is the protocol to be designed. 

In this multi-agent system, each agent can communicate with some other agents which are 
defined as its neighbors. Protocol itj is a state feedback, which is designed based on the state 
information received by agent i from its neighbors. We use the weighted directed graph Q(A) to 
represent the communication topology, where A = [a^-] is a given nxn nonnegative matrix, with 
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diagonal entries all being zeros. Vertex Vi represents agent i. Edge (v i: Vj) G Af(Q(A)) represents 
an available information channel from agent i to agent j. The neighbors of agent % are those 
agents whose information can be received directly by agent i. Thus, the set of neighbors of agent 
% just corresponds to the set J\f{Q{A) ) v i ). The leaders of this system are the agents, the vertices 
corresponding to which are the roots of some spanning trees of Q{A), i.e., the vertices that can 
be connected to any other vertices through paths [23]. The agents that are not leaders are called 
followers. Given certain agents, the local communication topology of them is the subgraph of 
Q{A), which is induced by the vertices corresponding to those agents. If A is time-dependent, 
then the underlying topology is said to be switching. In order to reflect the dependency on time, 
we use A{t) instead of A in this case. The switching topology will be discussed in detail in 
Section IV.D. Unless it is explicitly specified, A is assumed to be time-invariant. 

Given protocol Ui, i G T n , we say that Ui or this multi-agent system solves a consensus 
or agreement problem if for any given initial states and any j, k G l n , \xj(t) — Xk{t)\ — > 0, 
as t — > oo, and we say that it solves a finite-time consensus problem if it solves a consensus 
problem, and given any initial states, there exist a time t* and a real number k such that Xj (t) = k 
for t > t* and all j G Z„. If the final consensus state is a function of the initial states, namely, 
Xj(t) — >■ x(#(0)) for all j G X„ as t — > oo, where x '■ ^ n ~^ ^ is a function, we say that it solves 
the ^-consensus problem [4]. Specially, if x(x(0)) = the system is said to solve the 

average-consensus problem. 

We are now in a position to present two consensus protocols, which will be shown to solve 
finite-time consensus problems: 

(i) For i G I n , if Af(Q(A), v ;) = <fi, then ui = 0, else 

; (5) 

(ii) For i G X„, if Af(Q(A), vi) = 0, then Ui = 0, else 

Ui= ^2 aij sign(xj - Xi)\xj - Xi\ ai: > , (6) 

where < a i: aij < 1, | • | is the absolute value of real numbers, and sign(-) is the sign function 



Ui = sign 



Yl a 

yj£Af(G(A),i 



ij \Xj Xj 



} j a ij( x j x i) 



jeM(g(A),i) 
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defined as 

1, r > 
sign(r) = < 0, r — ■ 
-1, r<0 

For simplicity, sign(r)|r| a is denoted by sig (r) a for any a > 0. 

Remark: sig (r) a , a > 0, is a continuous function on R, which leads to the continuity of 
protocols © and ©. That will be discussed in Property [TJ If we set a,i — l,i G X n and 
ctij = € X n in the above protocols © and © respectively, then they will become the 

typical linear consensus protocol studied in [4] and [5], and they solve a consensus problem 
asymptotically provided that Q(A) has a spanning tree. If we set a« = and = in © 
and ©, they will become discontinuous. The discontinuous case of protocol © was studied 
by Cortes in [24], where G(A) is assumed to be a connected undirected graph and A is also a 
— 1 matrix. In the next section, we will investigate the mathematical conditions that guarantee 
protocol © or protocol © to solve a finite-time consensus problem. 

A. Basic Properties and Lemmas 

Property 1: Protocols © and © are continuous with respect to state variables X\, Xi, . . . , x n . 
Moreover, under either of those two protocols, there exists at least one solution of differential 
equations © on [0, oo) for any initial state x(0). Furthermore, maxjXj(t) is non-increasing and 
minjXi(t) is non-decreasing. Hence, ^(t)^ is also non-increasing and Hje^Uoc < ^(O)^ 
for all t > 0. 

Proof: Consider function f(r) = sig (r) Q , where < a < 1. If r > 0, then /(r) = r a 
is continuous, and lim r ._ >0 + r a = 0. If r < 0, then f(r) = — (— r) a is also continuous, and 
lim r ^ - — (— r) a = 0. From a = 0, we have that f(r) is continuous on R, and therefore, 
protocol © and © are continuous with respect to state variables x±,X2, ■ ■ ■ ,x n . 

Let E be the set {(£,£) : ||£||oo < ||ac(0) Hoo + 1, — r < t < r, r > 0}. Then E is open. Consider 
the solution when the domain of Ui is restricted in the open set E. By Peano's Existence Theorem 
(in the Appendix), there exists at least one solution of differential equations © on [0,i+] for 
some t + > 0. We extend the obtained solution over a maximal interval of existence (lu_,lu + ). 
At time t, t G [0, u + ), if Xj(t) = maXjXj(t), then ij(t) < 0, and if Xj(t) = minjXj(t), then 
Xj(t) > 0. Therefore maxjXj(t) is non-increasing and minjX^t) is non-decreasing. With the 
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same arguments, ||ac(i)||oo is a l so non-increasing for < t < u + . By Extension Theorem (in the 
appendix), (t,x(t)) tends to the boundary of E as t — > u+, which only occurs when co + = r. 
Because of the arbitrariness of r, there exists at least one solution of differential equation (|4]) 



Remark: In fact, any solution of the system can be extended over [0, oo) because it is bounded 



Moreover, one notices that © and © are not Lipschitz at some points. As all solutions reach 
subspace span(l) in finite time, there is nonuniqueness of solutions in backwards time. This, of 
course, violates the uniqueness condition for solutions of Lipschitz differential equations. 

The following property shows that the equilibrium point set of the considered differential 
equations = u^i £ X n , is the set of all consensus states. 

Property 2: With protocol © or ©, the equilibrium point set of the differential equations 
&i = Ui,i £ X„, is span(l), provided that Q{A) has a spanning tree. 

Proof: Since Q(A) has a spanning tree, there exists at most one agent, whose neighbor 
set is empty. Let £ = £ 2 , • • • , £ n ] T satisfy the equations Ui\ x= ^ — 0, i £ Z n . We prove 
£ £ span(l) by contradiction. Assume that mhij£j ^ maxj£j. Let Ai = {j : £j = min^} and 
let H = {j : £j = maxj^j}. Then Ai fl H = <p. Suppose that the root of the spanning tree is 
vertex vj. Then j £" Ai or j £" Ji or both hold. Without loss of generality, assume that j £" Ai. 
For any k £ Ai, there exists a path Vj — v^, Vi 2 , . . . , v is = Vk from Vj to Vk- Let I be the number, 
such that ii £ Ai but ^ 7W. Since > minj^j, £ Af(G,ii) and = min^, we 
have that n i; > 0, which is a contradiction. Thus, minj£j = maxj£j, namely, £ £ span(l). 

To prove the converse, suppose that £ £ span(l). Then all Ui\ x =£, i £ X n , are all zeros. 
Therefore, £ belongs to the equilibrium point set. ■ 

In order to establish our main results, we need the following Lemmas. 

Lemma 2: Let £i, £ 2) • • • , £n > and let < p < 1. Then 



on [0, oo) for any initial state ic(0). 



by 11^(0)11 




Proof: Obviously 



n 



n 



i=l 



i=l 
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Let U = {C = [Ci, C2, • • • , Cnf e R n : EILi = 1 and C > 0}. If Eti ^ 0, 

V^n tP 



(X)i=l £i 



™ / t \ P n 



where the last inequality follows from that ^ £ W. 

For any £ e W, ^™ =1 Cf 7^ 0- Since Y^=i Cf is continuous and W is a bounded closed set, 
inf^ eW Y^i=i Cf exists and is larger than 0. It can be calculated directly. Precisely, 

n 

inf VCf = min{n 1 - p , 1} = 1. 

i=i 

Thus, the left inequality holds. 
With the same arguments, 

7^|V ^ SU P E C P = maxK^, 1} = n 1 ^. 
lZ^=i «J Cew ^ 

Therefore, the right inequality also holds. ■ 
Lemma 3 (cf. [20], Theorem 1): Suppose that function V(t) : [0, 00) — > [0, 00) is differen- 
tiable (the derivative of V(t) at is in fact its right derivative), such that 

dV(t) 



where K > and < a < 1. Then V(t) will reach zero at finite time i* < T^z^j » anc ' 
V(t) = for all t > t*. 

Proof: Let /(i) satisfy differential equation 

Given initial value /(0) = V(0) > 0, its unique solution is 

-K(l-a)t + f(0y-°)^, t<^^, 



f(t) 



0, t >mizi 



— K(l-a) 

Since V(0) = /(0), by Comparison Principle of differential equations (in the Appendix), 
V(t) < f(t), t > 0. Hence, V(t) will reach zero in time ffff ' ~ " . Since V(t) > and ^ < 0, 
V(t) cannot leave zero once it reaches it. ■ 
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IV. Main Results 

A. Networks Under Protocol © 

In this subsection, protocol © is studied. The communication topology Q(A) is supposed 
to have a spanning tree, which is the least requirement when the topology is time-invariant. 
Otherwise, if Q(A) does not have a spanning tree, then there exist at least two groups of agents, 
between which there does not exist information exchange, and therefore it is impossible for the 
system to solve a consensus problem through distributive protocols. Furthermore, we hope that 
the state of the system reaches span (1) in a finite time. 

Now, we present our first main result. 

Theorem 1: If the communication topology Q(A) has a spanning tree, then system (HJ) solves 
a finite-time consensus problem when protocol © is applied. 

Proof: This theorem is proved through the following three steps. 

Step 1: Suppose that the communication topology Q(A) is strongly connected. 

By Lemma [H there exists a vector uj = [u>i, U2, ■ ■ ■ , co n } T E W 1 such that uj > and 
uj t L(A) = 0. Let yi = YTj=i a ij( x j ~ x { ),i E l n , and let y = [y 1 , y 2 , . . . , y n ] T . Then 

y = -L(A)x, 

and 

ii = sig (yi) ai . 

Since uj T y{t) = — uj t L(A)x{t) = —0x(t) = 0, y(t) _L uj. Consider nonnegative function 

n 
1=1 

which will be proved to be a valid Lyapunov function for the disagreement of agents' states. 

If Vi < 0, \ yi \ a > +1 = (- yi ) a * +1 and = -(a t + 1) = (a t + l)sig(y t ) a \ If 

Vi > 0, \yi\ a * +1 = yf i+1 and = (oj + l)yt l = (an + 1) sig (^) a< . Furthermore, the left and 

right derivatives of at are all 0. Consequently, for any y u 

— = (oj + 1) sig (yi) . 

dyi 
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Thus, 

dVi{t) _ A . % 



J^Wi sig (?/i) c 



i=i 

n 



i=i \ j=i 

Let a = [« 1; « 2 ,...,a n ] T , let sig(y)" = [sig (yx) 01 , sig (y 2 ) Q2 , . . . , sig (y n ) an } T and let 
sig {y T ) a = {sig{y) a ) T . Then 

= - sig (?/ T )"diag(o;)L(A) sig(y) a . 

Let a = maxjaj and let £? = |(diag(u;)L(A) + L(A) T diag(u;)). Suppose that Vi(t) ^ 0. 
Then y ^ 0, and 

= -i sig (diag(w)L(A) + L(Af diag(u>)) sig 

sig (y T ) ° B sig (y) a sig (y T ) " sig (y)^ , . 

Slg(y) Sig (if) ^(t)^ 

Since < a < 1, < < 1. In order to apply Lemma [3l we need to find lower bounds of 
the first two qualities in the right side of equality £7J). 

Let U = {£ : nonzero terms of £i, £2, • • • , £n are not with the same sign } and let U° = 
U fl : £ T £ =1}. Obviously, hi is a bounded closed set, namely, a compact set. From i/lw 
and cl> > 0, we have y E U, and from that function sig (r) Q conserves the sign of r, we have 
sig (y) a G U. Let £ 6 W°. Then £ ^ span(l) and therefore by Corollary [H $, T B^ > 0. Because 
the function £ T B£ is continuous and W° is compact, min^ eW o £ T B£, denoted by K 1 , exists and 
is larger than zero. Hence 

sig (y T ) a B sig (y) a = sig (y T ) a sig(y) a > 

8ig(» r ) a Big(») a ~ Vsig Sig (y)" Vsig sig (y) a " 

The last inequality follows from that , Slg ^ e W°. 
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Consider the second quality 
si 



ig(» T ) a sig(y) a _ Ztx\yi\ 2ai 



Vi(t) 1+a o fV n -J^-\v\ 1 + a ^ 1+a ° 

yz^,i=i i+oi 10*1 



Era I 
i=ra 1^'' 



1 2a, 



> t= " ' ( by Lemma El) 



o L..|(l+«*)lxS 



> 



I yi 



y 

2a, 



l + a 



Er=i( 



1 , ,2a,-(l+ ai )^0- 



l + a 



where / = argmaxj \yi\ 1+a o . 

Since < a, < a < 1, 1^" i% = (ijgfe) > °' which im P lies that 2«,-(l+«0i$^ < 
0. Therefore, function |r| 2a ' < - 1+a '- ) i+a d oes no t i ncre ase as |r| increases. Since < \yi(t)\ < 

\\y(t)\\oo = || - L(A)x(t)\\ 00 < ||L(A)|UI*(*)IU < ||£(A)|U|*(0)IU \ yi \ 2ai ~ {1+ai) ^ > 
(IlL^llioollx^lU^'-^^.Let 

K 2 = ^ min (||L( A) 11^11^(0) |U) 2ai - (1+a<) ^. 



Then K 2 > and 



Thus by ©, 



sig (y T ) a sig (y) a 



2<:v 



V-i{t) 1+a ° 

dW) <-^ 2 K(t)^,t>o. 



By Lemma [3l the above differential inequality gives that V\(t) reaches zero in finite time 



Hi 



^iS-ao)"" • If = °' then = °' which im P lies that Ui = 0,i e l n , and thus 

x(t) G span(l) by Property [2l Therefore the system solves a finite-time consensus problem. 

Step 2: Next, suppose that there exists only one leader and the local communication topology 
among the followers are strongly connected. By protocol ©, the state of the leader is time- 
invariant. Without loss of generality, suppose that agents 1,2, . . . ,m — n — 1 are the followers 
and agent n is the leader (because it is just a matter of relabeling the n agents). Consequently, 
flni, a«2, • • • , o-nn are all equal to zero. For notational simplicity, let b\ = a\ n , b 2 = a<i n , ■ ■ ■ ,b m — 
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a mn , let b = [61, b 2 , • • • , M T , let at = [ai, a 2 , ... , a m ], and let A = [ay]i<ij< m G R mxm . Since 
agent n is the leader, 6 7^ 0. Denote xi — x n by Xj, i G X m . Then for any z G X m , we have that 



SI 



j'=i 



Let ^ = Xljli Oij(a;j - x t ) - hxi, % G X m , and let y = y 2 , • • • , y m ] ■ Then 
y t = ^ Oij(sig (%) aj - sig (i/i)" 1 ) - ^ sig ,iel m . 

Since the local communication topology among the followers is Q(A) that is strongly con- 
nected, by Lemma [TJ there exists Gj = [u>x, u> 2 , . . . , uj rn ] T G IR m such that u> > and lj t L(A) = 
0. Define Lyapunov function V 2 (t) = Yh=i j^\Vi\ 1+ai - Obviously, V 2 (t) = if and only if 
y = 0. Notice that diag(uj) diag(6) = diag( [uiibi, io 2 b 2l ^m&m] T )- Then diag(u>)(L(A) + 
diag(B)) + (L(A) T + diag(6)) diag(u;) is positive definite by Corollaries Q] and [2l and thus 
L(A) + diag(5) is non-degenerate. And from y = — (L(A) +diag(6))[a; 1 , x 2 , ■ ■ ■ , x m ] T , we have 
that [xi, x 2 , ■ ■ ■ , Xm] T = if and only if y = 0. Therefore, V 2 (t) = if and only x(t) G span(l). 

Differentiate it with respect to time. 

dV 2 (t) 



dt 



- sig {y T ) a diag(u;)L(A) sig (y) a - sig (y T ) a diag(u>) diag(b) sig (y) a 
-sig (y T ) a (- (diag(w)L(A) + L(A) T diag(u;)) + diag(c) diag(6) ) sig (y) 



Let B = \ (diag(u;)L(A) + L(A) T diag(u;)) + diag(u;) diag(6) and a = max ieIm a,. Suppose 
that V 2 (t) ^ 0. 



— \ct 

■■Sq_ 



dV 2 (t) sig(y T ) a Bsig(y) a sig(y T ) a sig(y) 

— < ^— - — = — — — - — —- V 2 (t) 1+a o . 

dt sig(y T ) a sig(y) a V 2 (t)^k 

By Corollaries Q] and [2l B is real symmetric and positive definite. Let the smallest eigenvalue 
of B be Ai(-B). Then \ X {B) > 0, and for any £ G W m , $, T B$, > Ai(B)£ T £. Therefore, 

sig (y T ) a B sig (gT > , /„v 
sig(y J ) sig(y) 

With the same arguments as in the proof of inequality ([8]), there exists 

Ks = ^min(||L(A) 11^1^(0) lU) 2 ^-^^ > 



February 2, 2008 



DRAFT 



17 



such that 



Therefore, 



sig (y T ) a sig (y) 1 

V 2 (t) 1+ti o 



dV 2 (t) 
dt 



< -\ x {B)K z V 2 {t)^ . 



By Lemma [3l in this case, this system solves a finite-time consensus problem. 






(a) (b) (c) 

Suppose that (a) is the underlying communication topology, where the numbers in the circles are the indices of 
agents, and the numbers near the edges are the weights. The vertices in the dashed circle in (a) are the leaders, the 
local communication topology among which is strongly connected. After a period of time, the states of them will 
agree, and they can be viewed as one agent. The equivalent topology is (b), where 1' represents the virtue agent. 
In (b), by the conclusion of the second step, agent 4 and agent 6 will also agree with the leaders separately after 
a time. And then the equivalent topology becomes (c). And finally, they will reach a consensus on states. 



Fig. 2. Demonstration of the third step of the proof of Theorem |TJ 



Step 3: Finally, suppose that the communication topology G(A) has a spanning tree. 

Consider another directed graph Q, whose vertex set is the set of all strongly connected 
components of G(A), denoted by {ui,u 2 , ■ ■ ■ ,u m }, m < n. (ui,Uj) E £(G) if and only if there 
exist Vi> E V(ui) and ty e V(uj) such that (tv,ty) E 8{Q{A)). Then Q is uniquely determined 
by A and is a directed tree. Denote the root of Q by u si , where its vertex set corresponds to 
the leader set. Consider the states of agents associated with £(ui). Since Q is a directed tree, 



February 2, 2008 



DRAFT 



18 



there exists a path it si , u S2 , ■ ■ ■ , u Sl = Ui from the root u Sl to Ui. For the agents corresponding 
to the vertex set of u si , since the local communication topology u si among them is strongly 
connected, and the dynamics of them is not affected by others, by the conclusion of the first 
step, their states will reach a consensus in finite time t±. After time t±, the states of those agents 
are time-invariant. Therefore, under protocol ©, they can be viewed as one agent for the other 
agents. Denote this virtue agent by v\. Define a new weighted directed graph Q\. The vertex set 
is {vi} U £{u S2 ). For any Vj G £{u S2 ), (vx,Vj) G £(Gi) if and only if there exists v k G £(u Sl ) 
such that (vk,Vj) G £(Q(A)). And the weight of (vi,Vj) is the sum of the weights of all such 
edges as (vk,Vj). The induced weighted subgraph of Q\ by the vertices of u S2 is also u S2 and 
inherits its weights in Q(A). Notice that the dynamics of agents associated with £{u S2 ) under 
topology Q(A) is the same as the dynamics under topology Q\. Hence, by the conclusion of the 
second step, there exists time t 2 > t\, at which those agents will reach a consensus on states 
with the leaders. By induction, the states of agents corresponding to £(uj) will be the same as 
the leaders' final states in a finite time. The illustration of the proof is shown in Fig. [2l 
To conclude, the system solves a finite-time consensus problem. 

■ 

From the first step of the proof of Theorem Q3 we can see that 

Corollary 3: Suppose that Q(A) is strongly connected and there exists uj G IR n such that 
uj > and uS 1 L(A) = 0. If the following protocol 



where < ctj, ay < 1, is taken and the initial state x(0) satisfies uj t x(0) = 0, then the states of 
agents will reach zero in finite time. 

Remark: Notice that uj T x{t) = uj t L(A) sig (x) a = 0. Then uj T x{t) is time-invariant and 
LJ T x(t) = 0. Thus the above system is the same as the system of y in the first step of the proof 
of Theorem [Q And it is easy to check that the above system satisfies the Lipschitz condition at 
all points in span(l) except the origin, and thus it is impossible for the states of agents reach 
consensus in finite time on other agreement points. 



n 




(9) 
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B. Networks Under Protocol © 

In this subsection, we present conditions under which protocol © solves a finite-time consen- 
sus problem. In fact when the topology is dynamically changing, protocol © is also applicable. 
This case will be discussed thoroughly in the subsequent subsection. 

Unlike the discussions on protocol ©, here will present several theorems, which are valid in 
different cases, and are of interest themselves. 

Theorem 2: Suppose that communication topology Q(A) is undirected and connected. Then 
protocol © solves the finite-time average-consensus problem, if aty = ctji for all i G T n , 

jeM(G(A),t). 

Proof: First, complete definition of is provided. For any i 6 Z n , if j N(Q(A),i), set 
otij = r < max fc6 i n>/gA r ( g( A ) 5A .) a kl . Clearly in this case a i4 = 0. 
Since = dji and aij = a^, for all i,j Gl n , we get that 

n 

= 0. (10) 

i=l 

Let 




By dTO]), k is time-invariant. Let Xi(t) = k + 5i(t) and let S(t) = [6i(t), 5 2 (t), . . . , 5 n (t)] T . 
Then 5i(t) = &i(t). In [4], S(t) is referred to as the group disagreement vector. Consequently, 
l T S(t) = J27=i x, i(t) — uk = YH=i x i(t) ~ YH=x x i(t) = 0- We take Lyapunov function 

n 

i=i 

The remainder of the proof is to show that V^{t) satisfies the conditions of Lemma [3] for some 
K and a and then V${t) reaches zero in finite time, which yields that all agents' states reach a 
consensus in finite time and the final state is k, the average of their initial states. 
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Differentiate Vs(t) with respect to t. 

dV 3 (t) 



dt 



i=i 
1 - 

= 2 ( ai i 5i sig _ + a i^i sig ( 5i ~ 5 iT 31 ) (H) 

1 71 

= 2 a ^ ~~ ^ sig ~ <Ji ) ay 

i,i=l 

1 n 

i _ n _ / 2 !+«»-; \ 

= -iE(«r°(ft-*) 2 )^ 

i,j=l V / 

where a = maxjj a^- and equation (fTTI) follows from that <5j — 5j = Xj — Xj. From < a < L 

1 ^ l + QQ ^ 1 

2 ^ 2 ^ 

Suppose that V 3 (t) 7^ 0. By Lemma [2l 



l + QQ 



dv 3 (t) / 1 



1 +"0 
2 



- 2 



l+"0 
2 



.1 



The last equation follows from that Y17j=i a ij aa ~~ ^i) 2 7^ ^- ^ n ^ act ' ^ S7i=i — 
<5j) 2 = 0, then by the connectivity of £/(A), 5j = <5j for all i,j E X n , namely, 5 E span(l). 
Because 1 T 5 = 0, S = 0, and thus V^{t) = 0, which contradicts our assumption. Therefore, 



Next, we give the lower bounds of the first two qualities in the big brackets of equation (fl"2l) . 
By Property [Tj max^Xj — minjXj is non-increasing. For any i,j E T n , \5i(t) — 5j(t)\ < 
maxfcXfc(t) — minfcXfe(t) < maxfcXfc(O) — min^ £&(()). Let 

K4 = 2 — mm a i7 +a ° (maxxfc(O) — mina; fc (0)) 1+Q « , 

which is positive. Let (io,jo) = argmaxi, 3e x„ (5i — 5j) 2 . Since — 1 < 0, with the same 
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arguments as in the proof of inequality ([8]), 

e? j= i^((* - m 1 ^ > - ^o) 2 )^ 

2 

Now consider the second quality. Let B = [b^] G R nx?1 , where &y = a^ 1 "" . Then by Lemma 

m 

"'2 " 

£ ajpft - S s f = J2 - 5 if = 2S T L(B)S, 

i,j=l *J— 1 

and since 5 J_ 1, 

W) ~ - AX ^ B » > °- 

Therefore, 

< -- (4K 4 A 2 (L(B)))^ V 3 (t)^. 
Thus, by Lemma |H system © solves the finite-time average-consensus problem. 

■ 

The next theorem is on the case with a leader. 

Theorem 3: Suppose that the system consists of one leader and n — 1 followers and the local 
communication topology among the followers is undirected and connected. If = aji for 
all i,j such that agent i and agent j are neighbors of each other, then protocol © solves a 
finite-time consensus problem and the final common state is the state of the leader. 

Proof: First we define the undefined oty as in the proof of Theorem |2| and let m — n — 1. 
Without loss of generality, suppose that agents 1,2, ... ,m are the followers and agent n is the 
leader. From the provided conditions of this theorem, we have that a n \ = a n2 = ■ ■ ■ = a nn = 0. 
Let A = [aij]x<ij<m G M mxm , let b = [b u b 2 ,..., b m ] T = [a ln , a 2n , . . . , a mn ] T and let a = 
max^ atij. Then A T = A and 5^0. Rewrite protocol © 

m 

Ui = ^2 <kj sig (Xj - Xi) ai3 + bi sig (x n - x^f™ , i G X m . 
Let 5j = Xj — x n , i G X n . Then <5 n = and 

m 

4 = = % sig (5j - 5i) aiJ - h sig (5^" ,iel m . 
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Also consider the Lyapunov function V 3 (t) = \ J2^=i 
dV 3 (t) 



dt 



^ Sj ^ aij sig (<5j - 5i) a ' J - bi sig (<5i) c 



i=l 



1 m m 



8=1 



1 +"0 
2 



1 +"o 



\i,j=l i=l / 



The last inequality is obtained by Lemma [2l 



For simplicity, let Gi(<5) = £™=iC at % ~ fcl^* + 2 E™i 1^1^^ and let 

2 ' 7 2 

G 2 (<5) = E5=i a i +Q ° ( 5 j - + 2 £1=1 witn the same arguments as in the proof of 
inequality ©, 



gig) 
G 2 (<5) 



> if. 



where if 4 is defined in Theorem [2l 



Let £ = [a 1+a ° 



and let 6 = [bl +a ° , 



4- 



. . . , b 



i+<*olT 



. By Corollary H L( J B)+diag(b) 



is positive definite. Its smallest eigenvalue is denoted by \%(L(B) + diag(b)). Then 
G 2 {6) 2[6 U 5 2 ,..., 6 m } T (L(B) + diag(6))[5 1; 6 2 ,...,5 r> 



V 3 {t) ' l[5i,6 2 ,...,5 m ] T [6i,6 2 ,...,6 m ] 
Let B be the same as in the proof of Theorem [2] We have 



>4Ai(L(B)+diag(6)). 



B 



B b 





Therefore, 



L(B) 



L(B) + dmg{b) -b 




Its eigenvalues are all nonnegative numbers, and the second smallest eigenvalue of L(B), denoted 
by X 2 (L(B)), is Ai(L(B) + diag(b)). Thus, 

d -m<- l -(4KML(B)))^V 3 ( t )^. 
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By Lemma [H Vs(t) will reach zero in finite time, which implies that all agents' states reach the 
common value x n (0) in a finite time. ■ 

In the above analysis, we only consider the case when Q(A) is undirected or the local 
communication topology among the followers is undirected. To some extent, the above two 
results can be extended to the case when the communication topology belongs to the set of 
some special kinds of directed graphs. 

Definition 1 ([25]): Communication topology Q(A) is said to satisfy the detail balance con- 
dition in weights if there exist some scalars Ui > 0, i E X n , such that for all 
i,j E l n - 

We can see that in the detail-balanced communication topology, the communication channels 
among agents are also bidirectional like in undirected graphs, but with different weights. 

Corollary 4: Protocol © solves a finite-time consensus problem if Q{A) is strongly connected 
and detail-balanced, and ctij = ctji for all i E X n , j E J\f(Q(A), i). 

Proof: Let uj = [co>i,co> 2 , • • • ,^«] T such that a^ay = Ujdji for all i, j E T n and define the 
undefined as in the proof of Theorem |2l It is easy to check that diag(o;)A is symmetric and 

n 

^2uJiXi(t) = 0. 
1=1 

Let k = ™^ — r Y^i=x k^iW- Then k is time-invariant. Let 5i(t) = Xi(t)—n. Then u T 8(t) = 0. 
We take Lyapunov function V^(t) = | Y^i=i UJ ^i('t) 2 - 



dV A (t) 



1 n 

-j2^\^-^\ 1+aij - 



dt 2 

With the same argument as in the proof of Theorem [2l there exists K 5 > such that 

^f- < -KM®*?, 

where a = maxjj a^. The details are omitted. And thus this system solves a finite-time 
consensus problem, and the final state is ^n 1 Y^=i ^i^i(O), which can be viewed as a weighted 
average-consensus function. ■ 
The following corollary is also obtainable but the proof is omitted. 

Corollary 5: Suppose that the conditions are the same as in Theorem [3l except that the local 
communication topology among the followers is strongly connected and detail-balanced. Then 
protocol © solves a finite-time consensus problem. 
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Based on the results of Corollary 0] and Corollary [51 we can still extend those results further, 
though, for protocol ©, we cannot obtain results as desirable as for protocol ©. 

Theorem 4: If Q(A) has a spanning tree and each strongly connected component is detail- 
balanced, and (Xij = ctji for all i,j such that agent i and agent j are neighbors of each other, 
then protocol © solves a finite-time consensus problem. 

The proof of the above theorem is the same as the third step of the proof of Theorem [IJ 

C. Performance Analysis 

In this subsection, we investigate the relationship between the convergence time and the other 
factors, such as the underlying communication topology, parameters and a^- in the proposed 
protocols, and the initial states. The convergence time is defined as the time that the system 
spends to reach a consensus. For the studied nonlinear system, the precise time of reaching the 
consensus state is hard to given. However, we can analyze it by investigating its upper bound 
obtained by Lemma [3l 

We claim that Vi(t), V 2 (t), Vs(t) and V±{t) measure how much agents' states differ from each 
other. V s (t) and clearly measure the disagreement of agents' current states with their 

common final state by their definitions. Now consider V\{t). We take the same assumptions 
and notations as in Theorem [Q Let uj 1 - = E R n : uj t £ = 0}. Then uj 1 - is L (A) -invariant. 
Furthermore, for any £ e uj l , L(A)£ = -<=>- £ = 0. Therefore, = lb defines 

a vector norm on uj 1 - (see [26], Theorem 5.3.2). Furthermore, for any x, let x = rl + x 2 , where 
r G R and x 2 G u)^. 

\\L{A)x\\ 2 = a/ x t L(A) t L(A)x = sJxlL{A) T L{A)x 2 = \\x 2 \\ L{A) . 

And apparently, V\(t) is a measure of the length of L(A)x. Especially, if all are equal to 
a, < a < 1, and u> = 1, Vi(x(t)) = Y^(||-^(^4.)^||(i+ Q )) 1+a - Therefore, V x {t) can be seen 
as a measure of the length of vector x 2 , which reflects the disagreement of x with subspace 
span(l). In the same way, we can show that V 2 (t) also measures the disagreement of agents' 
states. Undoubtedly, larger initial value of V±(t), V 2 (t), Vs(t) and V±(t) will result in longer 
convergence time of the considered system by Lemma [3l This fact also can be reflected in the 
estimation of K 2 , K 3 and K 4 . 



February 2, 2008 



DRAFT 



25 



It is well known that, if a, or ay = 1 for all i,j, then the system at most asymptotically 
solves a consensus problem, and thus the convergence time becomes infinitively long. In our 
model, since limc^i = 1 and lim^.^i ^p 1 = 1, by Lemma |3l the estimated upper bound 
of convergence time tends to infinity, if all a, or ay tend to 1. 

In [4], it was proved that the larger the algebraic connectivity of the underlying communication 
topology is, the faster the system converges. To illustrate the dependency of the convergence 
time under protocol © or © on the algebraic connectivity of the communication topology, we 
assume that G(A) is undirected and connected, and all ctj or ay are all equal to a, < a < 1. 
For protocol ©, we consider Lyapunov function Vs(t) = \ J2ij=i a ij( x j(t) ~ x i(f)) 2 instead of 
V\{t). It can be shown that Vs(t) = -<=>• x 6 span(l) and 

dV 5 {t) 



l + a 



< -(2X 2 (L(A)))—V 5 (t) — . (13) 



dt 

For protocol ©, K4 can be taken to be 1, and 

< -\(iX 2 (L(B)))^V 3 (t)^ ', (14) 

where B = [aj^]. 

The above two differential inequalities show that larger algebraic connectivity of G(A) or 
G(B) can lead to shorter the convergence time (see Lemma [3]). 

The following two theorems compare the convergence rates of protocol © or protocol © 
with different parameters aj or under the same communication topology respectively. It is 
shown that smaller oii or ay can get better convergence rate when agents states differ a little 
from each other, and larger ctj or a^ can get better convergence rate when agents states differ a 
lot from each other. Therefore, in order to get better convergence rate, we can change the values 
of protocol parameters or ay based on the states of agents as system evolves. 

Theorem, 5: Suppose that G(A) is undirected and connected, protocol © is applied, and all 
a.i are equal, denoted by a. Then the eigenvalues of L(A) are nonnegative numbers (by Lemma 
[Q) and let them be Ai(L(A)), \ 2 (L(A)), . . . , \ n (L(A)) in the increasing order. Since G(A) is 
connected, Ai(L(A)) = and \ 2 {L(A)) > 0. Given < a* < a* < 1, let e* = 2 \ 2 {L(A)) na *~ a * 
and let e* = 2A (1(A)) • Consider Lyapunov function V 5 = | YHj=i a ij( x j(t) — x i(t)) 2 . If V 5 (t) > 
e*, then 



dV 5 (t) 



< dV 5 (t) 



dt 

a=a* 



dt 
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and if V 5 (t) < e*, 

Proof: Since 

dV 5 (t) 
dt 

by Lemma [2l 



dV 5 (t) 



dt 



< 



dV 5 (t) 



dt 



E 

i=l 



l+a 



n I i n 



l + a 
2\ 2 



i=i V Vj=i 



(15) 



1-a 

— n 2 



n / n 

EE 

»=i \i=i 



l+a 
2\ "S - 



n / it 



i=l \i=l 



l + a 

2\ 



It is easy to see that 



n / n 



E ) = x T L(A) T L(A)x, 

»=i \i=i 



and 



Let 



I? 



V r 5 (t) = -aj i J L(A)aj. 



A 2 (L(A)) 



A n (L(A)) 

Since L(A) is symmetric, there exists an orthogonal matrix T E M. nxn such that 

L(A) = T T DT. 

And, 

x T L(A) T L(A)x 2x T T T DTT T DTx 2x T T T D 2 Tx 



Therefore, 



\x T L(A)x x T T T DTx ' x T T T DTx ' 

, / / x T L(A) T L(A)x , . . aNN 

2A 2 (L(A)) < < 2A„(L(A)). 



(16) 



(17) 
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If V 5 (t) > e*, then 
dV 5 (t) 



dt 



< - (x T L(A) T L(A)x) * ( by CU)) 

- (x T L(A) T L(A)x) 1± ^ (x T L(A) T L(A)x)^^ 

< - (x T L(A) T L(A)x) 1±i± {2\ 2 {L{A))V 5 (t))^ ( by Q7J) 

< -n 1 ^ (a; T L(A) T L(A)cc) 1 ^ ii (by V 5 (t) > e*) 
dV 5 (t) 



< 



dt 



( by CL6])). 



If V^t) < e„ by (23, 



n / n 



E E a ^ - *«) ^ 2A n (L(A))y 5 (i) < 1. 
i=i \i=i / 

Therefore, for any i G Z n , (X]j= 

) ) < 1. And because a* < a* 



±±2. < i±sl. Thus 





By dl5J>, 



dV 5 (t) 



dt 



< 



dV 5 (t) 



dt 



Theorem 6: Suppose that Q (A) is undirected and connected, protocol © is applied, and all 



are equal, denoted by a. Let B = [aA*™]. Then the eigenvalues of L(B) axe nonnegative numbers 
(by Lemma [T]) and let the second smallest and the largest eigenvalues be X 2 (L(B)), X n (L(B)) 
respectively (which are positive). Given < a* < a* < 1, let 



and let 



2(1-"*) 



1 + 



1 + a* 



e „ = 2- 2 n^^- (\ n (L(B\ a=a *)))^=^ (X 2 (L(B\ a=a ,)))^ 



Consider Lyapunov function V3 (($(£)) = 5X^=1 ^1(0 (where S(t) was defined in the proof of 
Theorem O. If V 3 (t) > e*, then 



dV 3 (t) 



dt 



< 



dV 3 (t) 



a=a* 



dt 
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and if V 3 (t) < e*, 



dV 3 {t) 



dt 



< 



dV 3 {t) 



dt 



Proof: In the proof of Theorem [2l we get that 

dV 3 (t) 1 



dt 



and by Lemma [2l 



l-Q 



1 + q 
2 



l + q 

2 



2 y ^ -v ^-j -/ i ~ dt ~ 2 x 



(18) 



Moreover, since E" j= i^ + "(^ - <^) 2 = 18 T L(B)8, V 3 (t) = |<5 T <5, and <5_L1, by Lemma [TJ 

4A 2 (L(B))V 3 (*) < £ a.f* (5,- - 5i) 2 < 4\ n (L(B))V 3 (t). (19) 
By (O and (fT9l) . we have that 

<fy 3 (*) , 1 



(4A n (L(B))y 3 (t))— < 



dt <--(AX 2 (L(B))V 3 (t)) 



l + a 



If V 3 (t) > e*, then 



dt 



< - ~ (4A 2 (L( J BU =a ,))) 1 ^ 1 ^(O^W)^ ( by ©) 

< - i (4A 2 (L(B| a=a *)))^ n 1 -^*^* (A n (L(B| Q=Q J)) i ^ ± 
x (As^BU.*)))"^^) 1 ^ (by Va(t) > e*) 



n 



l-a* 



< 



2 



2 1+Q * (A n (L(B| Q=Q .))) — V 3 (t)~ 
(by ©). 



The case when V 3 (t) < can be proved in the same way. 



(20) 



D. Networks With Switching Topology 

In practice, the information channel between any two agents may not be always available 
because of the restrictions of physical equipments or the interference in signals from external, 
such as exceeding the sensing range or existence of obstacles between agents. Therefore, it is 
more reasonable to assume that the communication topology is dynamically changing. 
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In order to describe the switching property of the topology, suppose that Oy is a piece-wise 
constant right continuous function of time, denoted by c%(i), and takes value in a finite set, 
such that au(t) = for all i,t. And the changing topology is represented by Q(A(t)). We only 
study the validity of protocol © when the underlying topology is switching. As for protocol ©, 
the finite-time convergence analysis is more challenging and we leave it as one future research 
topic. In fact, for protocol ©, the parameter can also be changing to reflect the reliability 
of information channel (vj,Vi) as weight or to get shorter convergence time as indicated in 
Theorem [6] 

By investigating the properties of the two protocols, we can see that the main difference 
between the two protocols is that the Lyapunov function Vs(<5(£)) used in the proof of Theorem[2] 
does not depend on the network topology. This property of V 3 (S(t)) makes it a possible candidate 
as a common Lyapunov function for convergence analysis of the system with switching topology. 

Theorem 7: Suppose that Q(A(t)) is undirected and connected all the time, all are piece- 
wise constant right continuous functions of time, denoted by a.ij(t), and take values in a finite set 
such that aij(t) = oiji{t) and < < 1 for all i,j, t. Then protocol © solves the finite-time 
average-agreement problem. 

Proof: The proof is similar to that of Theorem [2] and we take the same notations as in the 
proof of Theorem[2l such as k, S(t) and B. Then k is also time-invariant. Let a = maxjj t otij(t) 
and take the Lyapunov function V s (S(t)). At any time t, we have an estimation of K A (t), which 
can be chosen to depend only on A{t) and the initial state cc(0). Since all possible A(t) and 
OLij{t) are finite, K e = mm t K 4 {t)\2(L(B(t))) exists and is larger than 0. Then 

Therefore, V s (t) will reach zero in finite time t* = - — aV ^° \+^ and the switching system 

(l-oo)Jif^ 

solves the finite-time average- agreement problem. ■ 
Remark: The conditions in Theorem |7] can be relaxed in several ways. For example, we can 
assume that the sum of time intervals, in which Q(A(t)) is connected, is larger than t*. In fact 
Q(A(t)) is not necessarily undirected. This condition can be replaced by that Q(A(t)) is always 
detail-balanced with a common u> > such that diag(o;) T A(t) is symmetric. 

In [3], [5] and [10], it was shown that under certain conditions, if the union of graph Q(A(t)) 
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across a bounded time interval is connected or has a spanning tree, the consensus problem is 
solvable asymptotically. However, in Theorem [7J if Q(A(t)) is not connected at any time, we 
cannot conclude that protocol © solves a finite-time consensus problem even though the union 
of Q(A(t)) across the time interval with a given length is connected. 
Example 1 (Counterexample): Let 



A 1 



1 

1 




and A 2 




1 
1 



Suppose that the system consists of three agents, communication topology G(A(t))\ te \ 2 k,2k+i) — 
Q{Ai), G(A(t))\ te[2k+li 2(k+i)) = G{A 2 ), k = 0,1,2,..., and protocol © is applied where 
Oij = 0.5 for all Consider the case when Q(Ai) is in effect. Obviously x 3 (t) is time- 
invariant and thus we only study the dynamics of agents 1 and 2 in time-interval [2k, 2k + 1). 
Let k = Ux 1 (2k) + x 2 (2k)), 6x(t) = x x {t)-K, S 2 (t) = x 2 (t) - k and V(t) = HS^t) 2 + 5 2 (t) 2 ). 



dV(t) 
dt 



-2 15 V(t) 



0.75 



If V(2k) < 0.25, then V(t) will reach zero before time 2k + 1. We can get the same result for 
Q(A 2 ). Given initial state x (0) = [0.3, 0.4, 0] T , \5i(t)\ < maxj x j (t) — mhij Xi (t) <maXjXj(0) — 
minjXj(O) = 0.4. In the same way, \S 2 (t)\ < 0.4. Therefore, V(t) < 0.16, and thus, the states 
of agents 1 and 2 are the same at time 2k + 1. In the same way, the states of agents 2 and 3 are 
the same at time 2, 4, 6, Therefore, 



1,2,.... 



0.5 0.5 
x(2k)= 0.25 0.25 0.5 x(0),k 
0.25 0.25 0.5 

Obviously, states of agents cannot reach consensus in finite time. In fact, this system asymptot- 
ically solves the average-consensus problem. 



V. Simulations 

In this section, we present some numerical simulations to illustrate our theoretical results. 
Fig. [3] shows the states of agents under protocol ©. The communication topology is given in 
Fig. El (a), and the initial state is [-0.6, -1, 0.4, 0, 1, 0.6, 0.2] T . For the case when 0.3 < a* < 0.8, 
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CO 

o 




Fig. 3. State trajectories of agents under the communication topology given in Fig. [2] (a) when protocol ((5} is applied. 



we let ax = 0.3, a 2 = 0.5, a 3 = 0.7, ct 4 = 0.8, a 5 = 0.5, a e = 0.6 and a 7 = 0.55. As 
a comparison, the last one in Fig. [3] is the states of agents under the typical linear consensus 
protocol in [4]. Since the agents' states differ a little from each other, we can see that the system 
converges fast when ctj is relatively small. 

The following simulations are performed with six agents. Fig. @] shows four connected undi- 
rected graphs and the weight of each edge is 2. 

To compare the convergence rates of of systems under protocol © or protocol © with 
different a i: or a^, we assume the underlying topology is Q 1 and all «j or a^- are equal to a. 
For protocol ©, a takes 0.3 and 0.8 separately. By TheoremEl if V 5 (t) > 7.4353, 



dt 



dVs(t) 
dt 



dV 5 (t) 



, and if V 5 (t) < 0.0569, ,, 

a=0.3 



< dV 5 (t) 
a=0.3 ~ dt 



< 

a=0.8 



. The initial state is chosen to be 

a=0.8 

T i\r ir\\ _ qqo\ „„j [n m n 1 q n nc (i no n nt; n nclT 



[-5,-3,7,9,4,5] T (y 5 (0) = 338) and [0.01, 0.13, 0.05, -0.09, 0.05, 0.08] T (Vb(0) = 0.0533) 
respectively. The states of agents are shown in Fig [51 For protocol ©, a also takes 0.3 and 0.8 
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© © © © © 



(c) 



Fig. 4. Four graphs: (a) Q\, (b) Q 2 , (c) Gs, (d) Q4 




© 6 



(b) 



4) 



© © — @>— 

D © © (£> 

(d) 



separately. By Theorem H if V 3 (t) > 42674, 



(it 



< 



dV 3 (t) 
dt 



< 



a=0.3 



dV 3 (t) 
dt 



o=0.8 



dt 



a=0.3 



, and if V 3 (t) < 0.000029, 



o=0.8 



. In fact, e* or e* given in Theorem [6] is too large or small, and it can be 



chosen to be smaller or larger. In our example, the initial state is also set to be [—5, —3, 7, 9, 4, 5] T 
(V 3 (0) = 78.4167) and [0.01, 0.13, 0.05, -0.09, 0.05, 0.08] r (V 3 (0) = 0.0138) respectively. The 
states of agents are shown in Fig [6] 

To show the effect of algebraic connectivity on the convergence time, consider the case when 
communication topology is Q 2 and £ 4 separately and and a, are all equal to a = 0.5. Let 
cc(0) = [—5, —3, 7, 9, 4, 5] T . The algebraic connectivity of Q2 is 2 and that of C? 4 is 0.5359. The 

upper bounds of convergence times estimated by differential equation (fT3l) are 6.0638 and 16.2819 

2 

separately. And the algebraic connectivity corresponding to £([a© a ]) of Q2 is 2.5198, and that 
of Q A is 0.6752. The estimated upper bounds of convergence times by differential equation (fl~4l) 
are 4.2085 and 11.2999. The states of agents under protocols © and © are shown in Fig. [7] 
and Fig. [8] separately. 

If the communication topology is switching from Qi, to Q 2 , to Q 3 , to C? 4 , and back to Q\, 
periodically, and each of them lasts for 0.25 seconds, then we apply protocol © and the states 
of agents achieve the average- agreement in finite time, the estimated upper bound of which is 
£ 3 = 11.2999. The trajectories of them are shown in Fig. [9j 
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Fig. 5. Comparison of convergence rates of the two systems under communication topology Si, where protocol ((5) is applied, 
and the two systems are with different protocol parameters ai. 




Time 



Time 



Time 



Fig. 6. Comparison of convergence rates of the two systems under communication topology Si, where protocol (|6j is applied, 
and the two systems are with different protocol parameters ctij. 
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Time Time 

Fig. 7. State trajectories of agents under communication topologies Q2 and Q4 when protocol ® is applied 

VI. Conclusion 

We have discussed the finite-time consensus problems for multi-agent systems and presented 
two effective continuous finite-time consensus protocols. Furthermore, the relationship between 
the convergence time and the communication topology, the initial states and the protocol parame- 
ters a;, or atij was analyzed. Several simulations demonstrated the effectiveness of our theoretical 
results. 

The work of this paper is the first step toward the finite-time consensus analysis of multi- 
agent systems, and there are still some other interesting and important topics to be addressed. 
For example, does protocol © still work when the communication topology has a spanning 
tree? If the system is under switching topology and with communication time-delays, do there 
exist similar results? Do there exist other effective finite-time protocols? These problems are 
currently under investigations. 
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Time Time 



Fig. 8. State trajectories of agents under communication topologies Q2 and Q4 when protocol l|6} is applied 




Time Time 

Fig. 9. State trajectories of agents under switching communication topology 
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Appendix I 

Gersgorin Disk Theorem ([26], pp. 344, Theorem 6.1.1): Let A e [a^] e C nxn , and let 

n 

^(A) = ^2\aij\,l <i <n 

2 = 1 

denote the deleted absolute row sums of A. Then all the eigenvalues of A are located in the 
union of n discs 

n 

\J{ceC:\c-a ll \<R> t (A)}. 

i=i 

Lemma 4 (see [26], Theorem 6.2.24): Let A E R nxn be a nonnegative matrix. The following 
are equivalent: 

1) A is irreducible; 

2) (I + A) 11 ' 1 > 0; 

3) Q{A) is strongly connected. 

Perron-Frobenius Theorem ([26], pp. 508, Theorem 8.4.4): Let A e M. nxn and suppose that 
A is irreducible and nonnegative. Then 

1) p(A) > 0; 

2) p(A) is an eigenvalue of A; 

3) There is a positive vector a? such that Ax = p(A)x; and 

4) p(A) is an algebraically (and hence geometrically) simple eigenvalue of A. 

Peano's Existence Theorem ([27], pp. 10, Theorem 2.1): Let y,f e M n ; f(t,y) continuous 
on i? : t < £ < + a > \\y — yo||oo < 6; M a bound for y)||oo on _R; a = min(a, b/M). 
Then differential equation 

= f(t,v),v(t ) = y 

possesses at least one solution y = y[t) on [t ,t + a]. 

Extension Theorem ([27], pp. 12, Theorem 3.1): Let f(t,y) be continuous on an open (t,y)- 
set E and let y(t) be a solution of y' = f(t,y) on some interval. Then y(t) can be extended 
(as a solution) over a maximal interval of existence (lu_,uj + ). Also, if (cj_,cj + ) is a maximal 
interval of existence, then y(t) tends to the boundary BE of E as t — > c<j_ and t — > cj + . 
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Comparison Principle ([27], pp. 26, Theorem 4.1): Let U(t,u) be continuous on an open 
(t,u)-set E and u = u°(t) the maximal solution of 

^ = U(t,u),u(t ) = u . 

Let v(t) be a continuous function on [to, t +a] satisfying the conditions u(t ) < «o> ^(0) e 
and v(t) has a right derivative D R (v(t)) on t < t < t + a such that 

D R v(t)<U(t,v(t)). 

Then, on a common interval of existence of u°(t) and v(t), 

v(t) < u°(t). 

References 

[1] T. Vicsek, A. Czirok, E. Ben-Jacob, I. Cohen, and O. Schochet, "Novel type of phase-transition in a system of self-driven 

particles", Phys. Rev. Lett., vol. 75, no. 6, pp. 1226-1229, 1995. 
[2] C. W. Reynolds, "Flocks, birds, and schools: a distributed behavioral model", Computer Graphics, vol. 21, pp. 25-34, 

1987. 

[3] A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mobile autonomous agents using nearest neighbor 

rules", IEEE Trans. Automat. Contr, vol. 48, no. 9, pp. 988-1001, 2003. 
[4] R. Olfati-Saber and R. M. Murray , "Consensus problems in networks of agents with switching topology and time-delays", 

IEEE Trans. Automat. Contr, vol. 49, no. 9, pp. 1520-1533, 2004. 
[5] W. Ren and R. W. Beard, "Consensus seeking in multiagent systems under dynamically changing interaction topologies", 

IEEE Trans. Automat. Contr, vol. 50, no. 5, pp. 655-661, 2005. 
[6] Y. Hatano and M. Mesbahi, "Agreement over random networks", IEEE Trans. Automat. Contr., vol. 50, no. 11, pp. 1867- 

1872, 2005. 

[7] A. V. Savkin, "The problem of coordination and consensus achievement in groups of automous mobile robots with limited 

communication", Nonlinear Analysis, vol. 65, pp. 1094-1102, 2006. 
[8] L. Fang and R J. Antsaklis, "Information consensus of asynchronous discrete-time multi-agent systems", in Proc. Amer. 

Control Conf., Jun. 2005, pp. 1883-1888. 
[9] D. P. Spanos, R. Olfati-Saber, and R. M. Murray, "Dynamic consensus on mobile networks", in IFAC World Congress, 

(Prague, Czech Republic), 2005. 
[10] L. Moreau, "Stability of multiagent systems with time-dependent communication links", IEEE Trans. Automat. Contr., vol. 

50, no. 2, pp. 169-182, 2005. 

[11] R. Olfati-Saber and J. S. Shamma, "Consensus filters for sensor networks and distributed sensor fusion", in Proc. IEEE 

Conf. Decision and Control, Dec. 2005, pp. 6698-6703. 
[12] H. G. Tanner and D. K. Christodoulakis, "State synchronization in local-interaction networks is robust with respect to time 

delays", in Proc. IEEE Conf. Decision and Control, Dec. 2005, pp. 4945-4950. 



February 2, 2008 



DRAFT 



38 



[13] F. Xiao and L. Wang, "State consensus for multi-agent systems with switching topologies and time- varying delays", 

International Journal of Control, vol. 79, no. 10, pp. 1277-1284, 2006. 
[14] D. Lee and M. W. Spong, "Agreement with non-uniform information delays", in Proc. Amer. Control Conf., Jun., 2006, 

pp. 756-760. 

[15] W. Ren, R. W. Beard, and E. M. Atkins, "A survey of consensus problems in multi-agent coordination", in Proc. Amer. 

Control Conf., Jun. 2005, pp. 1859-1864. 
[16] Y. Kim and M. Mesbahi, "On maximizing the second smallest eigenvalue of a state-dependent graph laplacian", IEEE 

Trans. Automat. Contr., vol. 51, no. 1, pp. 116-120, 2006. 
[17] L. Xiao and S. Boyd, "Fast linear iterations for distributed averaging", Systems & Control Letters, vol. 53, pp. 65-78, 

2006. 

[18] R. Olfati-Saber, "Ultrafast consensus in small-world networks", in Proc. Amer. Control Conf, Jun. 2005, pp. 2371-2378. 
[19] V. T. Haimo, "Finite time controllers", Siam J. Control and Optimization, vol. 24, no. 4, pp. 760-770, 1986. 
[20] S. R Bhat and D. S. Bernstein, "Finite-time stability of homogeneous systems". Proc. Amer. Control Conf, 1997, pp. 
2513-2514. 

[21] C. Godsil and G. Royal, Algebraic Graph Theory, New York: Springer- Verlag, 2001. 

[22] F. Xiao and L. Wang, "Consensus behavior of agents in networked systems under general communication topologies", in 

Proc. the 2006 IEEE International Symposium on Intelligent Control, 862-867, 2006. 
[23] F. Xiao , L. Wang, and A. Wang, "Consensus problems in discrete-time multiagent systems with fixed topology," Journal 

of Mathematical Analysis and Applications, vol. 322, no. 2, pp. 587-598, 2006. 
[24] J. Cortes, "Finite-time convergent gradient flows with applications to network consensus", Automatica, vol. 42, no. 11, pp. 

1993-2000, Nov. 2006. 

[25] T. Chu, L. Wang, T. Chen, and S. Mu, "Complex emergent dynamics of anisotropic swarms: convergence vs oscillation", 

Chaos Solitons & Fractals, vol. 30, no. 4, pp. 875-885, 2006. 
[26] R. A. Horn and C. R. Hohnson, Matrix Analysis, New York: Cambridge University Press, 1985. 
[27] R Hartman, Ordinary Differential Equations, 2nd edition, Birkhauser, 1982. 



February 2, 2008 



DRAFT 



